Barriers in the p-spin interacting spin-glass model. The dynamical approach. 
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We investigate the barriers separating metastable states in the spherical p-spin glass model using 
the instanton method. We show that the problem of finding the barrier heights can be reduced to 
the causal two-real-replica dynamics. We find the probability for the system to escape one of the 
highest energy metastable states and the energy barrier corresponding to this process. 



^3 

0^ 



I 



X3 
O 

o 



> 
in 
cn 

o 

0\ 



o 



X 
S3 



One of the most important properties of the spin 
glasses is the existence of large barriers separating 
metastable states. The calculation of the barrier heights 
is not a simple problem even for the long range spin-glass 
models for which the mean field theory is valid. Although 
the standard replica approachlil allows one to find all ther- 
modynamical properties, these properties do not contain 
information about the barrier heights. The usual dynam- 
ical mean field approach cannot be used either because it 
involves taking the limit iV — > cx) at an early stage of the 
calculation, in this limit all barriers become infinite. The 
modification of the replica approach allowijug to estimate 
the barrier heights was suggested in Ref.a. The modifi- 
cation of the dynamical theory allowing to calculate t 
barrier heights was suggested in our previous work Ref. 
fn the present paper we apply this method to the p-spin 
interacting spin-glass model. 

TherB-spin interacting model was investigated by the 
replicaQ, dynamicalBB, and Thouless-Anderson-Palmer 
(TAP)lI methods . The qualitative picture arising from 
these studies is the following, (i) The transition to the 
spin-glass state is discontinuous. Replica and dynamical 
theories give different results for the transition temper- 
ature, physically the former corresponds to the equilib- 
rium transition and the latter to the dynamical freezing 
preempting it. (ii) At all temperatures lower than the dy- 
namical transition temperature there is an exponential 
number of metastable stateaZl with energies distributed 
in some interval {Em, Eck)- For a typical state with 
the energy less than Eck the Hessian of fluctuations has 
strictly positive eigenvalues so such states are stable, for 
energies larger than Eck some of these eigenvalues be- 
come negative so a typical state is unstable; for energies 
lower than there are no states, (iii) Dynamical evo- 
lution starting from a random configuration leads to a 
non equilibrium riagime exhibiting very slow power law 
relaxation (aging)l3, in the following we shall refer to it 
as Cugliandolo-Kurchan (CK) regime. 

The structure of the phase space described above al- 
lows one to understand better the physics underlying 
the aging relaxation found inO. The number of states 
of a given energy, A/g, is exponentially large, Se = 
jf IuMe ~ for all energies larger than Em {Se^ = 
0); furthermore the complexity, Se, is a monotonic func- 
tion of the energy, E. Thus, a set of all locally stable 



states is dominated by the states with highest energy, 
Eck, for which these states are still locally stable and 
dynamics starting from random initial conditions is most 
likely to end up in one of these most abundant states. 
A typical state of the largest energy has one eigenvalue 
which is very close to zero, so the dynamical evolution 
leads to a marginally stable state but it approaches it 
very slowly, iiL agreement with the results of direct dy- 
namical studyQ. This qualitative argument can be made 
more precise. At time scales t weakly unstable states 
with eigenvalues A > —l/t are allowed. Because for the p 
spin model the maximal energy is directly related to the 
minimal allowed eigenvalue the states with Amin ~ —l/t 
dominate the dynamics at time scales t. These states 
are, of course, unstable with the average exponent of the 
order Aniin! for the correlation function it means that 

dtqit,t') = -lqit,t') 

with 7^1. The solution of this equation is a power 
law relaxsution, consistent with the result of the rigor- 
ous studyH. Another conclusion of this reasoning is that 
the upper bound Eck should be equal to the aswrnptotic 
energy of CK regime as, indeed, was found inQ. Thus, 
the dynamics starting from random initial conditions (i.e. 
from a state with E = Q) leads to the equilibrium states 
with E < Eck only in exponentially rare cases. How- 
ever, as we will show, these equilibrium states can be 
reached by the dynamical evolution if the system starts 
from a state with a sufficiently low initial energy, E < Ec- 
This will allow us to study the properties of these states 
in the framework of the dynamical theory. 

Our goal is to find the probability, V, for the system 
to escape one of the highest energy TAP states using the 
instanton method. Generally, V ^ exp N{—Eb/T + S) 
where E^ is the energy barrier corresponding to this tran- 
sition and S is the entropy (configurational) contribu- 
tion. Note the important difference with the usual prob- 
lem of activated transitions, there the contribution from 
the unique saddle point should be taken into account 
whereas here the number of saddle points is also expo- 
nential which modifies the result. The dependences of 
the energy barrier Eh and action A — —E^/T -I- S* on 
the temperature are plotted in Fig.l. As one expects, 
the barriers emerge at the dynamical transition temper- 
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ature. At low temperatures the entropy contribution to 
the action is negHgible and the action is A = —Eb/T. 




FIG. 1. The eflFective energy e = -{T\n'P)/N controlling 
probability of the decay of metastable states (full line) for 
p = 3; the dashed line shows the energy barrier Eb. 

The idea of our method is the following: Consider the 
system that is initially in one of the metastable states 
characterized by the energy Eim we want to find the 
probability to escape this state. Let us consider all sad- 
dle point trajectories (instantons) leading to transient 
states with energy Etr > Ein- Technically we can choose 
such trajectories inserting an appropriate delta-function 
constraint in the dynamical functional. After this pro- 
cess the system is left to relax. Apparently, if the tran- 
sient energy, Etr, is high enough, the system will relax 
to the state which is different from the initial one, in 
this case the spin-spin correlation function {S{ti)S{tf)) 
is zero. On the contrary, if the energy Etr is just a little 
above the energy of the initial stable state Ein, the sys- 
tem will relax to the same state and the spin-spin corre- 
lation function {S{ti)S{tf)) will be equal to the Edwards- 
Anderson (EA) order parameter. As we will show, there 
is a critical value, Ec, of the energy Etr, such that when 
Etr < Ec the system relaxes back to the same state while 
for Etr > Ec the system escapes. The difference between 
the critical value of the transient energy Ec and the en- 
ergy of the initial state Ein is exactly the barrier energy 
Eh = Etr — Ein, and the probability of the instanton 
transition is determined by the action of the instanton 
process corresponding to the transition over this barrier. 

We now provide the details of the calculation. Using 
the functional formulation of the dynamical theory (see, 
for example Ref.l3) we write the spin correlation function 
as a functional integral 
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7i is the Hamiltonian of the p-spin interacting model 

,i2...ip SilSi2---Sip. (3) 



T-C — r Jjl, 



and Jii i2 ip is a random symmetric tensor normalized 

The instanton motion from ij to ttr can be trans- 
formed into th&|USual causal motion with the help of the 
transformationti 



iSi{-t) = -dtSit) + iS{t), 



(4) 
(5) 



where ttr — was taken to make formulas more com- 
pact. In order to distinguish this time interval from the 
relaxational motion at t > ttr = we denote S field 



S2it)^Sit), S-2it)^S{t) 



(6) 



for i > 0. In the new notations the correlation function 
(|l|) becomes 

{S{t,)S{tf )) = e-'^^^y DSi DS2 e/o"'^!^! 

xe/o'^l^=Wl''*5(H(0) -iVi?t,)5i(-t,)^2(t/), (7) 

where = H{Q) - Hit,). 

We see that Eq. (^ ) corresponds to the two-real- replica 
problem with a fixed initial energy. The Green functions 
become matrices in the replica space 

E>a,f3 — (SaSfs), Ga,f3 — (SaiSp), D a^p — {iS alS fi) . 

The advantage of this representation is that since Eq.(0) 
describes the normal (relaxational) motion, the response 
functions Ga^p are casual and the anomalous Green func- 
tions Da, 13 = 0. Moreover, according to Eq.(0) the repli- 
cas are independent from each other, therefore 



Gl,2(tl,t2) =G2,l(tl,i2) =0. 



(8) 



Also we will be interested only in the replica-symmetric 
processes, for which one can write 



Dl,l{ti,t2) = D2,2{tl,t2) = D{ti,t2), 
Dl,2{tl,t2) = D2,l{tl,t2) = D'{ti,t2), 
Gl,l{tl,t2) ^ G2,2{h,t2) ^ G{ti,t2). 

Representing the delta-function in (|^) as 



6in{0) - NEtr) = 



i4>{H(0)~-N Etr)l3 



(9) 
(10) 

(11) 



(12) 



we perform averaging over the disorder. Then, making 
the saddle point approximation wc get the equations for 
the correlation functions: 
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-fi{p-l) f DP-\h,t)G{h,t)G{t,t2)dt^Q, (13) 
Jti 



[dti + l-p/3E{h)]D{h,t2) +pl3E{0)DP-\h,0)D{0,t2) 
- ii{p - 1) /" DP-^{h,t)G{h,t)D{t, t2) dt 



t2 

fi I DP-\tut)G{t2,t)dt = 0, 

10 



(14) 



[dti + 1 - pl3E{ti)] D'ihM) + pl3E{0)DP-\ti,{))D'{{), ia) 



ix{p - 1) /" DP-^ih,t)Gih,t)D'{t, t2) dt 



H D'" \tut)G{t2,t)dt^0, 
Jo 



(15) 



where the energy E is 

E{t) = -^ I dt'DP-\t,t')G{t,t') + E{0)DP{t,0), 
2 Jo 

(16) 

E{0) = Etr and fi = pP'^/2. The value of cf) in Eq.(|l|) 
at the saddle point is related to the initial energy EjO) 
by = £;(0)//3. Note that Eqs.(^3|jl|Jl|) describe the 
usual one-replica dynamics, because they do not contain 
the correlation function D'. Therefore, in order to find 
the most interesting correlation function D' we need first 
to find G and D solving Eqs.(|l|,0|6l) and then find D' 
from Eq.(|l|). 

Thus, we begin with the analysis of the one-replica 
equations ( p^JI^ , p^ ). When E{0) = the terms emerging 
from the energy constraint in Eqs.( p^ , p^ disappear and 
the asymptotics of the correlation functions should have 
the aging form found in Rcffl 



^(^1,^2)-^ ( , G{h,t2)^(^^ 



7-1 



, <1 > t2 » 1, 



where 7 is a constant depending on temperature. Nu- 
merical analysis of Eqs.(|l3|,|4 16) shows that this aging 
regime is still realized when E{0) is higher than some 
negative critical value Ec, which we will find analytically 
later. 

For £^(0) < Ec the numerical solution shows that the 
system relaxes to a stable state with correlation functions 
satisfying FDT at large times (ii,i2 ^ !)• In this case 
the limiting value of the energy, i?i„, and the Edwards- 
Anderson order parameter, q, characterizing this state 
can be found analytically: At large times ti,t2 ^ 1 the 
Green functions depend only on the time difference ti — 
t2 = T and FDT holds 9^-D(r) = -G{t). Using these 
facts one can integrate Eq.(O) over r obtaining 



- pl3 E,n = ^ qP-^) + 



(17) 



where q = D{t + T,t), i, t ^ 1. Considering Eq.(|lJ) on 
times ti ^ 1, t2 = we get 



p/3 S„ - m(1 - 9"^') -p^q^^'Etr ~ 1 



(18) 



where qi is the overlap between the initial and final states 
qi — D{t,0), i ^ 1. The equation closing the system 
(|l7|,pl) follows form Eq.(pl) 



■pf3 E,n^ f^l-qn-PpQiEu 



(19) 



Combining Eqs.( |l7| , |lq , |l9| ) and introducing a new variable 
z — /3(1 — q) q'^P^'^we get the equation 



^z' + {p\Etr\z) 



(20) 



which contains only one parameter Etr- Therefore, all 
the temperature dependence of q (at fixed Etj.) comes 
from the equation z =h3(1 — q) ^(P"^)/^, this agrees with 
TAP approach of Ref.Ll. One can show that Eq. (j2^) has 
solutions only when Etr < Ec, with 



Ec 



-{2p)-^'\p - 2)(2-p)/2(p _ i)(p-i)/2^ (21) 



which is related to the dynamical transition temperature 
Tc by Ec = -l/2Tc. For Etr < Ec Eq.{^ has two solu- 
tions but only one of these solution s is physica l, it lies in 
the interval < z < Zc with Zc = y^2/{p — l)p. 

Eqs.( |l7| , p"8|jl9| ) can be solved analytically for one spe- 
cial value of the energy Etr — — /3/2. In this case E — 
Etr, qi = q and Eqs.( p7|jl^ , [l9| ) are reduced to a single 
equation 



q 



'P-^l^q) = l. 



(22) 



This special value of the energy has a simple physical 
meaning: The system remains at the same state and it 
is at equilibrium at all times during the process. 

To summarize the results of one-replica dynamics: 
When Etr > Ec the system relaxes to the aging CK state, 
when Etr < Ec the system relaxes to one of the locally 
stable states. There is a special value Etr = — /3/2 such 
that the system is at the equilibrium for all times. 

Now turn to the behavior of the correlation function 
D' . Numerical solution of Eq.([l^) gives the following 
asymptotics of the correlation function D' : 

Etr < Ec : D'{ti,t2) ^ qsA, h,t2 ^ 00, (23) 
Etr>Ec: D\h,t2)^0, ti,t2-^oo. (24) 

It means that for energies Etr < Ec the replicas re- 
lax to the same state, while for Etr > Ec to differ- 
ent ones. For the original problem it means that when 
Etr < Ec the system remains in the same TAP state af- 
ter the instanton process, while for Etr > Ec the system 
escapes the original state. The result (E3) can also be ob- 
tained analytically by considering Eq.([15[) and assuming 
that FDT holds at large times. Thus we conclude that 
Eh = Ec — Ein is the energy of the barriers between the 
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highest energy TAP states. The height of the barrier Ef, 
as a function of temperature is plotted on Fig.l. 

The probabihty to escape a metastable state is e'^^ 
where the action A is 



The differentiation of (p5|) with respect to (3 gives 



(25) 



RT) = hn - Tg - r(l + ln(2^))/2, (32) 

where the third term corresponds to the conventionalB 
normaUzation of the trace over spins. We define the 'free 
energy' of a random state with a given energy E as 



fR{E) ^E- TSr, 



(33) 



where Sr is the 'entropy' of the random state defined by 



Using the transformation law (^,g|) we get 

dA -n{0)+HiU) 



d/3 



N 



-E-ir + -Eli 



(26) 



To integrate (|2^) it is convenient ±o use the result for the 
free energy of TAP states of Ref.Q 



(27) 



Note that this expression docs not contain the complexity 
contribution. Using Eqs.(|2C|,|27|) one can check that 



(28) 



Ein — , ^ Pfin • 

dp 

Therefore for the action we have 

A = Phn - EtrP - T{Etr), 



(29) 



where T is an unknown function which depends only on 
Etr- This function can be found from the following ar- 
guments. As was shown above there is a special value 
of Etr — ■~/3/2 for which the system is at equilibrium 
for all times. It means that actually there is no instan- 
ton motion, therefore the action of this process is zero. 
Imposing this requirement and using Eq.(p2[) we find T, 
inserting it in (29) we finally get 



A = El+Etr[3-[[3hn-9{z% 



where 



p-1 



p 



(30) 



(31) 



and z is determined by Eq.(|20|). The function g{z) turns 
out to be the same as-the complexity of the free energy 
minima found in Ref.LlIn order to get the action which 
determines the probability to escape a metastable state 
one should take Etr = E^ in (^0|). The result is plotted 
in Fig.l. 

The result (|3^) can be presented in a very simple form 
if we introduce the " full" free energy including complex- 
ity following Ref.Q 



{5{NE-H{S))^ 



- ^NSr 



(34) 



The straightforward calculation gives Sji{E) = (ln27r + 
l)/2 — i?^. Then the action A becomes 



A=[fn{Etr,T)-f{T)]/T. 



(35) 



We see that with these definitions of the free energies the 
action has a form corresponding to the Gibbs rule. 

In conclusion, we found the energy barriers between 
metastable states with energies E w Eck, E < Eqk 
using the instanton method. Mapping of the instanton 
motion into the usual motion going back in time allows 
to reduce the problem to the causal two-real-replica dy- 
namics. The probability to escape a metastable state is 
determined by the action of the instanton process, this 
action is expressed through the "full" free energy of the 
system that includes complexity. The method developed 
in the paper can be applied to study the free energy struc- 
ture of other spin-glasses. The drawback of this method 
is that it does not allow one to find all saddle point trajec- 
tories, instead it finds only a typical one, corresponding 
to a typical barrier; in particular, in the p-spin model 
we were able to study only the transitions between the 
most abundant states with E k, Eqk- Ideally one wants 
to know the barrier (or distribution of barriers) separat- 
ing two states with given energies; this is a much more 
difficult problem which remains unresolved. 
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